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Picture Processing Apparatus and Picture Processing 

Method 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a picture 
processing apparatus and a picture processing method 
that are suitable for a television receiver that 
performs both a multiple-picture display of which a 
plurality of pictures are displayed in a row on a 
background screen and a reduced picture display of 
which a reduced picture is^displayed along with an on- 
screen picture such as text. 
Description of the Related Art 

A television receivers that can perform both 
a multiple-picture display of which a plurality of 
pictures are displayed in a row on a background screen 
and a reduced picture display of which a reduced 
picture is displayed along with an on-screen picture 
such as text. Fig. 1 shows an example of a displaying 
apparatus of such a television receiver. 

In Fig. 1, a plurality of video signals are 
input from input terminals 102A, 102B, and so forth to 
an input signal selecting portion 101. The input 
signal selecting portion 101 selects two video signals 
of two sources that are displayed on the screen from 
the video signals that are input from the input 
terminals 102A, 102B, and so forth. 
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The selected two video signals of two sources 
are supplied to A/D converters 103A and 103B. The A/D 
converters 103A and 103B digitize two video signals of 
two sources that have been selected by the input signal 
selecting portion 101. The two video signals of two 
sources that have been digitized by the A/D converters 
103A and 103B are supplied to a picture processing 
portion 104. 

The picture processing portion 104 performs a 
multiple-picture displaying process and a reduced 
picture displaying process . To accomplish such 
processes, the picture processing portion 104 has a 
picture memory 105. 

_ _ When two pictures are displayed, the two 

video signals of two sources are written to the picture 
memory 105. At desired timings, the two video signals 
of two sources are read from the picture memory 105 and 
displayed on the background screen. At that point, the 
two video signals of two sources are thinned out or 
interpolated so as to adjust the picture sizes. 

Output signals of the picture processing 
portion 104 are supplied to a D/A converter 106. The 
D/A converter 106 converts the output signals of the 
picture processing portion 104 into analog signals. 
Output signals of the D/A converter 106 are supplied to 
a CRT display 107. 

Video signals supplied to the input terminals 



102A, 102B, and so forth may for example letter box 
signals or side panel signals that contain non-picture 
portions . 

There are three types of formats of video 
signals . The three types of video signals differ in 
the number of effective pixels. The number of 
effective pixels of the first type is (720 x 480). The 
number of effective pixels of the second type is (1280 
x 720). The number of effective pixels of the third 
type is (1920 x 1080). 

In the first format of which the number of 
effective pixels is (720 x 480), the angle of view is 
(4 : 3) that is a standard screen. In the second 
format of which the number of effective pixels is (1280 
x 720) and the third format of which the number of 
effective pixels is (1920 x 1080), the angle of view is 
(16 : 9) that is a wide screen. 

As shown in Fig. 2A, when the angle of view 
is 16 : 9 and the aspect ratio of the effective picture 
area is 4 : 3, black non-picture portions are added to 
the left and right of the picture so that the angle of 
view becomes 16:9. Such a signal is referred to as 
side panel signal. 

In addition, as shown in Fig. 2B, when the 
angle of view is 4 : 3 and the aspect ratio of the 
effective picture area is 16 : 9, black non-picture 
portions are added to the top and bottom of the picture 



so that the angle of view becomes 4:3. Such a signal 
is referred to as letter box signal. 

Thus, as shown in Fig. 2A, a side panel 
signal has non-picture portions on the left and right 
of the picture. On the other hand, as shown in Fig. 
2B, a letter box signal has non-picture portions at the 
top and bottom of the picture. Thus, as was described 
above, when an input video signal is written to the 
picture memory 105 and read therefrom at a proper 
timing corresponding to the screen position in a 
predetermined picture size, i f the input video sign al 
is a letter box signal or a side panel si gnal, th e non- 
picture portions are also pr ocessed. Thus, when a 
multiple-picture displaying process is performed, the 
picture of the side panel signal or letter box signal 
becomes small. On the other hand, when the reduced 
picture displaying process is performed, the display 
area on the screen cannot be effectively used. 

Figs. 3A, 3B, and 3C show an example of which 
two pictures are displayed with a picture of a side 
panel signal and a picture of a full line signal. 

As shown in Fig. 3A, all the picture of a 
side panel signal S101 that contains left and right 
non-picture portions is written to the picture memory. 
The picture size of the video signal written to the 
picture memory is adjusted in the size of all the 
picture. On the other hand, as shown in Fig. 3B, a 



full line signal S102 is written to the picture memory. 
The picture size of all the picture of the video signal 
is adjusted in the picture memory. The adjusted 
picture is read from the picture memory and displayed 
on the background screen. As a result, as shown in 
Fig. 3C, two pictures that are a picture G101 formed 
with the side panel signal S101 and a picture G102 
formed with the full line signal S102 are displayed. 
- As shown in Figs. 3A and 3B, the aspect ratio 

of the effective picture area of each of the two 
signals S101 and S102 is (4 : 3). Thus, the pictures 
will be displayed in the same size. However, as shown 
in Fig. 3C, when the two pictures G101 and G102 are 
displayed in a row, due to the left and right non- 
picture portions, the picture G101 formed with the side 
panel signal S101 becomes smaller than the picture G102 
formed with the full line signal S102. 

Figs. 4A and 4B show an__fix^mple of which the 
area of a picture of a side panel signal Sill is 
reduced on the display screen. As shown in Fig. 4A, 
all the picture of the side panel signal Sill that 
contains the left and right non-picture portions is 
written to the picture memory. The picture size of the 
video signal written to the picture memory is adjusted 
in the size of all the picture. The adjusted picture 
is read from the picture memory and displayed on the 
background screen. As shown in Fig. 4B, in addition to 




a picture Gill formed with the side panel signal Sill, 
an on-screen picture G112 such as text is displayed. 

In this case, since the picture of the side 
panel signal Sill contains the left and right non- 
picture portions, ^^e reduced picture Gill has a 
wasteful portion. Due to the wasteful portion, the 
area for the on-screen display picture G112 such as 
text becomes small. Consequently, the utilization 
efficiency of the screen becomes low. 

OBJECTS AND SUMMARY OF THE INVENTION 
Therefore, an object, of the present invention 
is to provide a picture displaying apparatus and a 
picture v displaying method that allow pictures to be 
prevented from becoming small in a multiple-picture 
displaying process and a wasteful picture portion to be 
prevented from being processed wi thout deterioration of 
utilization factor of the screen in a reduced picture 
displaying process even if input video signals are side 
panel signals or letter box signals. 

A first aspect of the present invention is a 
picture processing apparatus, comprising a determining 
means for determining whether or not an input video 
signal is a signal of which a non-picture portion is 
added to the periphery of an effective picture area, 
and a picture processing means for extracting a signal 
of the effective picture area from the input video 



signal, adjusting the picture size using the signal of 
the effective picture area, and combining the picture 
when the determined result of the determining means 
represents that the input video signal is a signal of 
which a non-picture portion is added to the periphery 
of the effective picture area. 

A second aspect of the present invention is a 
picture processing method, comprising the steps of (a) 
determining jwhether or not an input video signal is a 
signal of which a non-picture portion is added to the 
periphery of an effective picture area, and (b) 
extracting a signal of the effective picture area from 
the input video signal, adjusting the picture size 
using the signal of the effective picture area, and 
combining the picture when the determined result at 
step (a) represents that the input video signal is a 
signal of which a non-picture portion is added to the 
periphery of the effective picture area. 



video signal is a video signal that contains non- 
picture portions such as a side panel signal or a 
letter box signal. When a multiple -picture displaying 
process or a reduced picture displaying process is 
performed, if the input video signal is a side panel 
signal or a letter box signal, only a video sijjnal_fif 



the effective picture area is extracted and read from a 



picture memory and displayed on the screen. Thus, when 



It is determined whether or not an input 





the multiple-picture displaying process is performed, 
even if an input video signal is a side panel signal or 
a letter box signal, the display picture does not 
become small. On the other hand, when the reduced 
picture displaying process is performed, the display 
area can be effectively used. 

These and other objects, features and 
advantages of the present invention will become more 
apparent in light of the following detailed description 
of a best mode embodiment thereof, as illustrated in 
the accompanying drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1A is a block diagram showing an 
example of a conventional picture displaying apparatus; 

Figs. 2A and 2B are schematic diagrams 
showing a display example of the conventional picture 
displaying apparatus; 

Figs. 3A, 3B, and 3C are schematic diagrams 
showing a display example of the conventional picture 
displaying apparatus ; 

Figs. 4A and 4B are schematic diagrams 
showing a display example of the conventional picture 
displaying apparatus ; 

Fig. 5 is a block diagram showing an 
embodiment of the present invention; 

Figs. 6A and 6B are block diagrams for 
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explaining a display example of the embodiment of the 
present invention; 

Figs. 7A, 7B, and 7C are schematic diagrams 
showing a display example according to the embodiment 
of the present invention; 

Figs. 8A and 8B are schematic diagrams 
showing a display example according to the embodiment 
of the present invention; 

Figs. 9A and 9B are schematic diagrams 
showing a display example according to the embodiment 
of the present invention; 

Figs. 10A, 10B, IOC, and 10D are schematic 
diagrams showing a display example according to the 
embodiment of the present invention; 

Fig. 11 is a block diagram showing another 
embodiment of the present invention; 

Figs. 12A, 12B, 12C r and 12D are schematic 
diagrams showing a display example of the other 
embodiment of the present invention; 

Figs. 13A, 13B, 13C, and 13D are schematic 
diagrams showing a display example according to the 
other embodiment of the present invention; 

Figs. 14A and 14B are schematic diagrams 
showing a display example according to the other 
embodiment of the present invention; and 

Figs. 15A and 15B are schematic diagrams 
showing a display example according to the other 



embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Next, with reference to the accompanying 
drawings, embodiments of the present invention will be 
described. Fig. 5 shows an example of a picture 
displaying apparatus according to the present 
invention. 

In Fig. 5, reference numeral 1 is an 
interface that inputs a plurality of video signals. 

There are the following picture formats for 
video signals. The first picture format is (720 x 480) 
format of which the number of effective pixels is 720 x 
480. The second picture format is (1280 x 720) format 
of which the number of effective pixels is 1280 x 720. 
The third picture format is (1920 x 1080) format of 
which the number of effective pixels is 1920 x 1080. 
In the (720 x 480) format, the angle of view is (4 : 3) 
that is a standard screen. In the (1280 x 720) format 
and the (1920 x 1080) format, the angle of view is (16 
: 9) that is a wide screen. In addition, in each of 
the (720 x 480) format, the (1280 x 720) format, and 
the (1920 x 1080) format, there are two types of 
scanning formats that are interlace scanning and 
progressing scanning . 

As the interface 1, S terminal, D terminal, 
component terminal, or the like is used. 
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The D terminal was standardized for a digital 
broadcast. In the D terminal, (Y, Pb, and Pr) 
component signals and a picture format identifying 
signal are transmitted. The D terminal has five types 
Dl to D5 that depend on broadcast formats. 

The S terminal is used to separately input a 
luminance signal and a chroma signal. The component 
terminal uses three pins for component signals. A 
standard, television (480i) uses the S terminal, whereas 
a HDTV (10801) uses the component terminal having three 
pins. 

The interface 1 has a connection ID detecting 
portion 4 . The connection ID detecting portion 4 
detects the picture format of a video signal that is 
input . 

When a video signal is input using the D 
terminal or the S terminal, the picture format of the 
input video signal can be determined with an output 
signal of the interface 1 . An output signal of the 
connection ID detecting portion 4 is supplied to a 
microprocessor 5. The microprocessor 5 determines the 
picture format of an input video signal with an output 
signal of the connection ID detecting portion 4 . 

Video signals that are input from the 
interface 1 are supplied to an input signal selecting 
portion 2. The input signal selecting portion 2 
selects two video signals of two sources that are 




displayed on the screen from the video signals that are 
input through the interface 1. 

The two video signals of two sources that are 
selected by the input signal selecting portion 2 are 
supplied to A/D converters 6A and 6B. The A/D 
converters 6A and 6B digitize the two video signals of 
two sources selected by the input signal selecting 
portion 2. Output signals of the A/D converters 6A and 
6B are supplied to a picture processing portion 7. 

The two video signals of two sources selected 
by the input signal selecting portion 2 are supplied to 
an additional information detecting portion 8. The 
additional information detecting portion 8 detects 
additional information added to or superimposed with 
the signals and determines the picture formats of the 
input video signals corresponding to the detected 
additional signals. For example, in an EDTV-II ID 
signal or an ID-1 signal, the aspect ratio of a picture 
and the angle-of -view information are superimposed as 
additional information. The additional information 
detecting portion 8 detects additional information 
added to or superimposed with an input video signal. 
The additional information is supplied to the 
microprocessor 5. The microprocessor 5 determines the 
picture format of an input video signal with additional 
information detected by the additional information 
detecting portion 8 . 
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With an output signal of the connection ID 



detecting portion 4, corresponding to the information 
of the interface 1, the picture format of an input 
video signal is determined. In addition, the 
additional information detecting portion 8 determines 
the picture format of an input video signal with 
additional information added thereto or superimposed 
therewith. Corresponding to the determined picture 
format, it is determined whether the input video signal 
is a side panel signal, a letter box signal, or a full 
line signal. 

In addition, the two video signals of two 
sources selected by the input signal selecting portion 
2 are supplied to a non- signal detecting portion 9. 
The non -signal detecting portion 9 compares the level 
of each input video signal with a predetermined level. 
Output signals of the non- signal detecting portion 9 
are supplied to the microprocessor 5 . The 
microprocessor 5 detects the size^ o f the effectiv e 
pi cture area of each input video si gnal with each 
compare d out put . When the effective picture area in 
the horizontal direction is small, the microprocessor 5 
determines that the input video signal is a side panel 
signal. When the effective picture area in the 
vertical direction is small, the microprocessor 5 
determines that the input video signal is a letter box 



signal . 
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As will be described later, information that 
represents whether an input video signal is a letter 
box signal or a side panel signal is used for a 
multiple -picture displaying process and a reduced 
picture displaying process. 

The picture processing portion 7 performs a 
process for placing pictures corresponding to the two 
video signals of two sources selected by the input 
signal selecting portion 2 at proper positions on the 
background screen. In addition, the picture processing 
portion 7 performs a process for displaying a picture 
corresponding to one input video signal as a reduced 
picture on the background screen and for displaying an 
on-screen picture such as text on the background 
screen . 

An output signal of the picture processing 
portion 7 is supplied to a D/A converter 12. The D/A 
converter 12 converts the output signal of the picture 
processing portion 7 into an analog signal. An output 
signal of the D/A converter 12 (namely, an analog 
signal) is supplied to a CRT display 13. 

As described above, the picture processing 
portion 7 performs the multiple -picture displaying 
process and the reduced picture displaying process. 
These processes are accomplished by writing input video 
signals to a picture memory 11, thinning out or 
interpolating video signals therein at proper timings. 



and reading the resultant video signals so as to adjust 
the picture sizes. 

For example, when the multiple-picture 
displaying process is performed, two video signals of 
two sources selected by the input signal selecting 
portion 2 are written to the picture memory 11. The 
two video signals of two sources are thinned out or 
interpolated at proper timings so that desired picture 
sizes are obtained corresponding to the display 
positions on the screen. The resultant pictures are 
read from the picture memory 11 and combined on the 
background screen. 

However, each input video signal may be a 
- side panel signal or a letter box signal. In the side 
panel signal, the aspect ratio of the effective picture 
area is (4 : 3) and black non-picture portions are 
added to the left and right thereof so that the angle 
of view becomes 16 : 9. In the letter box signal, the 
aspect ratio of the effective picture area is (16 : 9) 
and black non-picture portions are added to the top and 
bottom thereof so that the angle of view becomes 4:3. 
Since a side panel signal and a letter box signal 
contain no n - pictur e portions, when an input video 
signal is wr^itjten_J:o_the_-pictur^ memory 11, adjusted in 
a predetermined picture size at a proper timing 
corresponding to a position on the screen, and read 
from the picture memory 11, if the input video signal 



is a side panel signal or a letter box signal, a 
displaying process is performed for the non-picture 
portions . 

Thus , according to the embodiment of the 
present invention, the microprocessor 5 determines 
whether each of the selected video signals is a side 
panel signal, a letter box signal, or a full line 
signal. In the case that each of the selected video 
signals is a side panel signal or a letter box signal, 
when the multiple-picture displaying process or the 
reduced picture displaying process is performed, only a 
video signal of the effective picture area is extracted 
from the video signal stored in the picture memory 11. 

In other words, as shown in Figs. 6A and 6B, 
the picture memory 11 has a memory space composed of 
horizontal addresses xa to xb and vertical addresses ya 
to yb for one screen of an input video signal. Thus, 
an input video signal for one screen is written to the 
memory space composed of horizontal addresses xa to xb 
and vertical addresses ya to yb. 

When an input video signal is a full line 
signal, all the video signal written to the memory 
space composed of horizontal addresses xa to xb and 
vertical addresses ya to yb is effective. 

On the other hand, when an input video signal 
is a side panel signal, as shown in Fig. 6A, the 
portion surrounded by horizontal addresses xc to xd and 



vertical addresses ya to yb of the video signal of one 
screen written to the picture memory 11 is an effective 
picture area. Thus, the portion surrounded by 
horizontal addresses xa to xc and vertical addresses ya 
5 to yb and the portion surrounded by horizontal 

addresses xd to xb and vertical addresses ya to yb are 
non-picture portions . 

On the other hand, when an input video signal 
is a letter box_signal, as shown in Fig. 6B, the 
10 portion surrounded by horizontal addresses xa to xb and 

vertical addresses yc to yd of the video signal for one 
screen written to the picture memory 11 is an effective 
picture area. The portion surrounded by horizontal 
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fO addresses xa to xb and vertical addresses ya to yc and 

m 

the portion surrounded by horizontal addresses xa to xb 
IP and vertical addresses yd to yb are non- picture 

W portions . 

pk. When the multiple -picture displaying process 

or the reduced picture displaying process is performed, 

20 if an input video signal is a side panel signal, as 

shown in Fig. 6A, only a video signal of the effective 
picture area surrounded by horizontal addresses xc to 
xd and vertical addresses ya to yb is extracted from 
the video signal for one screen written to the picture 

25 memory 11 and displayed. On the other hand, if an 

input video signal is a letter box signal, as shown in 
Fig. 6B, only a video signal of the effective picture 
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area surrounded by horizontal addresses xa to xb and 
vertical addresses yc to yd is extracted from the input 
video signal and displayed. 

Thus, when the multiple-picture displaying 
process or the reduced picture displaying process is 
performed, if an input video signal is a side panel 
signal or a letter box signal, only a video signal of 
the effective picture signal is extracted from the 
input video signal and displayed. As a result, when 
the multiple-picture displaying process is performed, a 
picture formed with a side panel signal or a letter box 
signal can be prevented from becoming small. When the 
reduced picture displaying process is performed, a 
wasteful portion can be prevented from being displayed. 
Thus, the screen can be effectively used. 

As was described above, the determination of 
which a.n input video signal is a side panel signal, a 
letter box signal, or a full line signal can be 
performed with an output signal of the connection ID 
detecting portion 4, an output signal of the additional 
information detecting portion 8, or an output signal of 
the non-signal detecting portion 9. 

In other words, when the interface 1 is S 
terminal, D terminal, or the like, the angle-of -view 
information and aspect ratio of an input video signal 
can be obtained with information of the interface 1. 
On the other hand, when an input video signal is a 
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signal of which additional signal is added to or 
superimposed with a video signal for example an EDTV-II 
ID signal or an ID-1 signal, the aspect ratio and 
angle-of -view information can be detected from the 
additional information. Information of the interface 1 
is detected by the connection ID detecting portion 4. 
The detected information is supplied to the 
microprocessor 5. The additional information added to 
or superimposed with the input video signal is detected 
by the additional information detecting portion 8 and 
supplied to the microprocessor 5 

The microprocessor 5 obtains the angle-of - 
view information and aspect ratio information of the 
input video signal from the information detected by the 
connection ID detecting portion 4 or the information 
detected by the additional information detecting 
portion 8 and determines whether the input video signal 
is a side panel signal, a letter box signal, or a full 
line signal. 

When the determined results with the 
information of angle-of view and the information of 
aspect ratio represent that the angle of view is (4 : 
3) and the aspect ratio of the effective picture area 
is (16 : 9), the input video signal is a letter box 
signal of which non-picture portions are added to the 
top and bottom of a picture whose effective picture 
area is (16 : 9) so that the angle of view becomes (4 : 
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3). Likewise, the determined result with information 
of the aspect ratio represents that the aspect ratio of 
the effective picture area is (4 : 3), the input video 
signal is a side panel signal of which non-picture 
portions are added to the left and right of a picture 
whose effective area is (4 : 3) so that the angle of 
view becomes (16 : 9). 

However, there is a situation of which 
information about the picture format of an input video 
signal cannot be obtained with neither information of 
the interface 1, nor additional information of the 
input video signal. In this case, the non- signal 
detecting portion 9 compares the level of an input 
video signal with a predetermined level. With the 
compared signal, the size of the effective picture area 
is detected. When the effective picture area in the 
horizontal direction is small, it is determined that 
the input video signal is a side panel signal. On the 
other hand, when the effective picture area in the 
vertical direction is small, it is determined that the 
input video signal is a letter box signal. 

In the example, with three types of 
information that are information of the interface 1, 
information added to or superimposed with an input 
video signal, and detected information of non-picture 
portions of an input video signal, it is determined 
whether the input video signal is a side panel signal, 
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a letter box signal, or a full line signal. Of course, 
it is not necessary to use all three types of 
information. Instead, either information of the 
interface 1, information added to or superimposed with 
an input video signal, or detected information of non- 
picture portions of the input video signal may be used. 
The combination and priority of these three types of 
information will be determined in consideration of the 
installation environment, cost, performance, and so 
forth. 

When the multiple-picture displaying process 
or the reduced picture displaying process is performed, 
if an input video signal is a side panel signal or a 
letter box signal, only a video signal of the effective 
picture area is extracted from the input video signal 
and displayed. Thus, when the input video signal is a 
side panel signal or a letter box signal, the size of 
the picture does not become small. In addition, the 
display area of the screen can be effectively used. 

Figs. 7A, 7B, and 7C show an example of a 
multiple-picture (two picture) display. In this 
example, it is assumed that one video signal of two 
input video signals of two sources is a side panel 
signal SI and the other video signal thereof is a full 
line signal S2 . 

As shown in Fig. 7A, all the picture of the 
side panel signal SI that contains left and right non- 




picture portions is written to the picture memory- A 
video signal of the effective picture area is extracted 
from the video signal. The picture size of the 
effective picture area is adjusted in the picture 
memory. The adjusted picture is read from the picture 
memory and displayed. On the other hand, as shown in 
Fig. 7B, all the picture of the full line signal S2 is 
written to the picture memory. In the picture memory, 
the picture size is adjusted to the size of all the 
picture. The adjusted picture is read from the picture 
memory. The picture is displayed on the background 
screen. Thus, as shown in Fig. 7C, two pictures of a 
picture Gl formed with the side panel signal SI and a 
picture G2 formed with the full line signal S2 are 
displayed. 

As shown in Fig. 7C, in the example, when 
only the effective picture area is extracted from the 
side panel signal SI, the size of the picture Gl formed 
with the side panel signal SI can be matched with the 
size of the picture G2 formed with the full line signal 
S2. 

Figs . 8A and 8B show a display example of a 
reduced picture in the case that an input video signal 
is a side panel signal. As shown in Fig. 4A, all the 
picture of the side panel signal Sll that contains left 
and right non-picture portions is written to the 
picture memory. A video signal of the effective 



picture area is extracted from the video signal written 
to the picture memory. The picture size is adjusted in 
the effective picture area. The adjusted picture is 
read from the picture memory. The picture is displayed 
on the background picture. As shown in Fig. 8B, in 
addition to a picture Gil formed with the side panel 
signal Sll, an on-screen picture G12 such as text is 
displayed. 

As shown in_Fig. 8B, when a reduced picture 
is displayed, if an input video signal is a side panel 
signal, a video signal of the effective picture area is 
extracted from the video signal written to the picture 
memory and displayed. Thus, non-picture portions in 
the horizontal direction are removed from the a reduced 
picture Gil formed with the side panel signal Sll. 
Consequently, the on-screen picture G12 such as text 
can be effectively displayed. 

Figs . 9A and 9B show an example of a reduced 
picture display in the case that an input video signal 
is a letter box signal. As shown in Fig. 9A, all the 
picture of a letter box signal S21 that contains top 
and bottom non-picture portions is written to the 
picture memory. A video signal of the effective 
picture area is extracted from the input video signal 
written to the picture memory. In the effective 
picture area, the picture size is adjusted. The 
adjusted picture is read from the picture memory and 



displayed on the background screen. As shown in Fig. 
9B, in addition to a picture G21 formed with the side 
panel signal S21, an on-screen picture S22 such as text 
is displayed. 

As shown in Fig. 9B, when a reduced picture 
is displayed, if an input video signal is a letter box 
signal S21, a video signal of the effective picture 
area is extracted from the input video signal written 
to the picture memory and displayed. Thus, the reduced 
picture G21 formed with the letter box signal S21 does 
not contain non-picture portions in the vertical 
direction. Thus, the on-screen picture G22 such as 
text can be effectively displayed. 

In the above description, as an example- of 
the multiple-picture displaying process, two pictures 
are displayed. Of course, more than two pictures can 
be displayed. 

Figs. 10A and 10B show an example of three 
pictures displayed as a multiple -picture display. In 
the example, as shown in Fig. 10A, all the picture of a 
side panel signal S31 that contains left and right non- 
picture portions is written to the picture memory. A 
video signal of the effective picture area is extracted 
from the video signal written to the picture memory. 
In the effective picture area, the picture size is 
adjusted. The adjusted picture is read from the 
picture memory. 



All the picture of a letter box signal that 
contains top and bottom non-picture portions is written 
to the picture memory. A video signal of the effective 
picture area is extracted from the video signal written 
to the picture memory. In the effective picture area, 
the picture size is adjusted. The adjusted picture is 
read from the picture memory and displayed. 

All the picture of a letter box signal S33 
that contains top and bottom non-picture portions is 
written to the picture memory. A video signal of the 
effective picture area is extracted from the video 
signal written to the picture memory. In the effective 
picture area, the picture size is adjusted. The 
adjusted picture is read from the picture memory and 
displayed. 

Thus, as shown in Fig. 10D, three pictures of 
a picture G31 formed with the side panel signal S31, a 
picture G32 formed with the letter box signal S32, and 
a picture G33 formed with the letter box signal S33 are 
displayed in a row on the background screen. 

In the above description, all the picture of 
a video signal is pre-written to the picture memory 11. 
When the multiple-picture displaying process or the 
reduced picture displaying process is preformed, if an 
input video signal is a side panel signal or a letter 
box signal, only a video signal of the effective 
picture area is read and extracted from the input 



picture signal. However, when an input video signal is 
a side panel signal or a letter box signal, only a 
video signal of the effective picture area may be 
written to the picture memory. The input video signal 
is read from the picture memory so as to extract a 
video signal of the effective picture area from the 
input video signal. 

Fig. 11 shows another embodiment of the 
present invention. In the example, in addition to two 
video signals of two sources selected by the input 
signal selecting portion 2, a received picture of a 
digital satellite broadcast corresponding to MPEG 
(Moving Picture Coding Experts Group) 2 standard can be 
displayed. For simplicity, in Fig. 11, similar 
portions to those in Fig. 5 will be denoted by similar 
reference numerals and their description will be 
omitted. 

In Fig. 11, an intermediate frequency signal 
of a digital satellite broadcast is supplied to an 
input terminal 20. For example, in a digital BS 
(Broadcast Satellite) broadcast, a radio wave of 12 GHz 
band transmitted from a satellite is received by a 
parabola antenna (not shown) . An LNB (Low Noise Block 
down converter) disposed on the parabola antenna 
converts the radio wave into a BS broadcast 
intermediate frequency signal BS-1F. The intermediate 
frequency signal BS-1F is supplied to the input 



terminal 20. In a digital CS (Communication Satellite) 
broadcast, the LNB converts the radio wave into a CS 
broadcast intermediate frequency signal CS-IF. The CS 
broadcast intermediate frequency signal CS-IF is 
supplied to the input terminal 20. 

The signal that is input from the input 
terminal 20 is supplied to a front end 21. The front 
end 21 demodulates the received signal and outputs an 
MPEG2 transport stream. The transport stream 
demodulated by the front end 21 is supplied to a 
demultiplexer 22. The demultiplexer 22 depacketizs the 
transport stream corresponding to PID. An output 
signal of the demultiplexer 22 is supplied to an MPEG2 
video decoder 24. 

The MPEG2 video decoder 24 decompresses the 
MPEG2 video signal. The video signal decoded by the 
MPEG2 video decoder 24 is supplied to a picture 
processing portion 7. 

In the example, an input terminal 23 is 
disposed so as to decode an MPEG2 transport stream of 
another medium received from the outside of the 
apparatus. In addition, an input terminal 25 is 
disposed so as to decode an MPEG2 video signal of 
another medium received from the outside of the 
apparatus . 

Thus, in the example, an MPEG2 transport 
stream is decoded. The decoded video signal is sent to 



the picture processing portion 7 . 

In addition to video signals selected by the 
input signal selecting portion 2 , the picture 
processing portion 7 performs a multiple-picture 
displaying process or a reduced picture displaying 
process for the video signal decoded by the MPEG2 video 
decoder 24. 

As was described above, when the multiple- 
picture displaying process or the reduced picture 
displaying process is performed, if each input video 
signal is a side panel signal or a letter box signal, a 
process for extracting only a video signal of the 
effective picture area from the input video signal and 
displaying- the effective picture area is performed. 

In the above -described example, the 
determination of whether an input video signal is a 
side panel signal, a letter box signal, or a full line 
signal is performed with information of the interface 
1, information added to or interpolated with the input 
video signal, or detected information of non-picture 
portions of the input video signal. On the other hand, 
when an input video signal is an MPEG2 decode signal, 
the determination of whether an input video signal is a 
side panel signal or a letter box signal is performed 
with information transmitted as an MPEG2 transport 
stream. 

In other words, the aspect ratio and angle of 

28 



view of a picture transmitted in an MPEG2 system can be 
represented with Sequencejeader and 
Sequence_Display_Extension . 

For example, in a BS digital broadcast 
system, Horizontal_Size_Value (HSV) of Sequence_Header 
represents the horizontal size of the entire picture. 
Vertical^ Size_Value (VSV) represents the vertical size 
of the entire picture. Aspect_Ratio_Inf ormation (ARI) 
represents the aspect ratio of the effective picture 
area. 

Display_Horizontal_Size (DHS) of 
Sequence_Display_Extension represents the horizontal 
size of the effective picture area. 

Display_JVertical_Size (DVS) represents the vertical 
size of the effective picture area. 

Thus, when an input video signal is a full 
line signal, Horizontal_Size_Value (HSV) matches 
Display_Horizontal_Size (DHS). In addition, 
Value„Size_Value (VSV) matches Display_Vertical_Size 
(DVS) . 

When an input video signal is a letter box 
signal, Horizontal_Size_Value (HSV) matches 
Display_Horizontal_Size (DHS) . Display_Vertical_Size 
(DVS) is smaller than Vertical_Size_Value (VSV). 

When an input video signal is a side panel 
signal, Display_Horizontal_Size (DHS) is smaller than 
Holizontal_Size_Value (HSV). Vertical_Size_Value (VSV) 



matches Display_Vertical_Size (DVS) . 

In such a manner, the value of 
Horizontal_Size_Value (HSV) is compared with the value 
of Display_Horizontal_Size (DHS). In addition, the 
5 value of Vertical_Size_Value (VSV) is compared with the 

value of Display_Vertical_Size (DVS). With the 
compared results, it can be determined whether an input 
video signal is a full line signal, a side panel 
signal, or a letter box signal. In addition, with 
10 Horizontal_Size (DHS) and Display_Vertical_Size (DVS), 

o 



the size of the effective picture area can be 
determined. 

Thus, when an input video signal is an MPEG2 
video signal, Horizontal_Size_Value (HSV) is compared 



lSj^ with Display_Horizontal_Size (DHS). In addition, 

1W Vertical_Size_Value (VSV) is compared with 

P 

W Display_Vertical_Size (DVS). A process for extracting 

O 

y*. a video signal of the effective picture area from the 

input video signal corresponding to the smaller 
20 parameters. 

Next , a display example of which video 
signals selected by the input signal selecting portion 
2 and a video signal decoded by the MPEG2 video decoder 
24 are supplied to the picture processing portion 7 
25 will be described. 

Figs. 12A to 12D show a display example of 
which two input video signals of two sources that are 
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selected are letter box signals and a video signal 
decoded by an MPEG2 decoder is a side panel signal. 

As shown in Figs. 12B and 12C, all the 
picture of each of the selected two letter box signals 
S42 and S43 of two sources that contain top and bottom 
non -picture portions is written to the picture memory. 
A video signal of the effective picture area is 
extracted from each of the signals. In the effective 
picture area, Jthe picture size is adjusted. The 
adjusted picture of each signal is read from the 
picture memory and displayed on the background picture. 

As shown in Fig. 12A, all the picture of a 
side panel signal S41 that has been decoded by the 
MPEG2 decoder and that contains top and bottom non- 
picture portions is written the picture memory. 
Horizontal_Size_Value (HSV) is compared with 
Display_Horizontal_Size (DHS) . Vertical_Size_Value 
(VSV) is compared with Display__Vertial_Size (DVS). 
Corresponding to the smaller parameters, a video signal 
is extracted from the picture memory and displayed on 
the background picture. 

Thus, as shown in Fig. 12D, three pictures 
that are a picture G41 formed with the side panel 
signal S41 decoded by the MPEG2 decoder and pictures 
G42 and G43 formed with the selected two letter box 
signals of two sources are displayed. 

Figs. 13A to 13D show a display example of 



which one of selected two input video signals of two 
sources is a side panel signal, the other is a letter 
box signal, and a video signal decoded by the MPEG 
decoder is a side panel signal. 
5 As shown in Fig. 13A, all the picture of one 

side panel signal S51 of the selected two input video 
signals of two sources that contains left and right 
non-picture portions is written to the picture memory. 
A video signal of the effective picture area is 

10 extracted from the video signal written to the picture 

CI 

■J3 memory. In the effective picture area, the picture 

€1 

|jj size is adjusted. The adjusted picture is read from 

€3 

\| the picture memory and displayed on the background 

Ifi 

screen . 

ll* As shown in Fig. 13C, all the picture of the 

other letter box signal S53 of the selected two input 



¥*? video signals of two sources that contains top and 

bottom non-picture portions is written to the picture 
memory. A video signal of the effective picture area 
20 is extracted from the video signal written to the 

picture memory. In the effective picture! area, the 
picture size is adjusted. The adjusted picture is read 
from the picture memory and displayed on the background 
screen. 

25 As shown in Fig. 13B, all the picture of a 

letter box signal S52 that has been decoded by the 
MPEG2 decoder and that contains top and bottom non- 
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picture portions is written to the picture memory. 
Holizontal_Size_ Value (HSV) is compared with 
Display_Horizontal_Size (DHS). In addition, 
Vertical„Size_Value (VSV) is compared with 
Display_Vertical_Size (DVS) . Corresponding to the 
smaller parameters, a video signal is extracted from 
the picture memory. 

Thus, as shown in Fig. 13D, three pictures 
that are a picture G51 formed with the side panel 
signal S51 of one of the selected two input video 
signals of two sources, a picture G52 formed with the 
letter box signal S52 decoded by the MPEG2 decoder, and 
a picture G53 formed with the letter box signal S53 of 
the other of the selected two input video signals of 
two sources are displayed. 

Figs. 14A and 14B show a display example of 
which a decoded video signal is a side panel signal 
that is displayed as a reduced picture . As shown in 
Fig. 14A, all the picture of a side panel signal S61 
that has been decoded by the MPEG2 decoder and that 
contains left and right non-picture portions is written 
to the picture memory. Horizontal_Size_Value (HSV) is 
compared with Display_Horizontal_Size (DHS) . In 
addition, Vertical_Size^_Value (VSV) is compared with 
Display_Vertical__Size (DVS) . Corresponding to the 
smaller parameters, a video signal is extracted from 
the picture memory. As shown in Fig. 14B, in addition 




to a picture G61 formed with the letter box signal S61 
an on-screen picture G62 such as text is displayed* 

Figs, 15A and 15B show a display example of 
which a video signal decoded by the MPEG2 decoder 24 i 
a letter box signal and displayed as a reduced picture 
As shown in Fig. 15A, all the picture of a letter box 
signal S71 that has been decoded by the MPEG 2 decoder 
24 and that contains top and bottom non-picture 
portions is written to the picture memory. 
Horizontal_Size_Value (HSV) is compared with 
Display_Horizontal_Size (DHS) . In addition, 
Vertical_Size_Value (VSV) is compared with 
Display_Vertial_Size (DVS). Corresponding to the 
smaller parameters, a video. signal is extracted from 
the picture memory. As shown in Fig. 15B, in addition 
to a picture G71 formed with the letter box signal, an 
on-screen picture G72 such as text is displayed. 

As was described above, according to the 
present invention, if an input video signal is a side 
panel signal or a letter box signal, when the multiple 
picture displaying process or the reduced picture 
displaying process is performed, a signal of the 
effective picture area is extracted. Thus, when the 
multiple-picture displaying process is performed, even 
if a side panel signal or a letter box signal is input 
the picture does not become small. In addition, when 
the reduced picture displaying process is performed. 



since a wasteful portion is not displayed, the display 
screen can be effectively used. 

In the above -described example, in addition 
to the multiple-picture displaying process and the 
reduced picture displaying process, the picture 
processing portion 7 can perform a variety of 
processes. For example, the picture processing portion 
7 can perform PinP (Picture in Picture) process of 
which a picture formed with one of two video signals 
selected by the input signal selecting portion 2 is 
used as a parent picture, a picture formed with the 
other video signal is reduced and used as a child 
picture, and the child picture is displayed in the 
parent picture. In the PinP process, when only the 
effective picture area of the child picture is 
extracted, the background picture can be effectively 
used. 

When an input video signal is a side panel 
signal or a letter box signal, a horizontal 
interpolating process and a vertical interpolating 
process are required so as to display the picture on 
the entire screen. When an input video signal is a 
side panel signal or a letter box signal, the picture 
processing portion 7 performs a process for causing the 
picture to be displayed on the entire screen. For 
example, when an input video signal is an EDTV signal, 
since it is a letter box signal, a process for 
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converting the number of lines is performed so as to 
display the picture on the entire screen. 

According to the present invention, it is 
determined whether or not an input video signal is a 
signal containing non-picture portions such as a side 
panel signal or a letter box signal. When the 
multiple -picture displaying process or the reduced 
picture displaying process is performed, if an input 
video signal is a letter box signal or a side panel 
signal, only a video signal of the effective picture 
area is extracted from the video signal written to the 
picture memory and displayed. Thus, when the multiple- 
picture displaying process is performed, even if the 
input video signal is a side panel signal or a letter 
box signal, the display picture does not become small. 
In addition, when the reduced picture displaying 
process is performed, the display area can be 
effectively used. 

Although the present invention has been shown 
and described with respect to a best mode embodiment 
thereof, it should be understood by those skilled in 
the art that the foregoing and various other changes, 
omissions, and additions in the form and detail thereof 
may be made therein without departing from the spirit 
and scope of the present invention. 



